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Abstract 

We study the coincidence theory of maps between two manifolds of 
the same dimension from an axiomatic viewpoint. First we look at co- 
incidences of maps between manifolds where one of the maps is orien- 
tation true, and give a set of axioms such that characterizes the local 
index (which is an integer valued function). Then we consider coincidence 
theory for arbitrary pairs of maps between two manifolds. Similarly we 
provide a set of axioms which characterize the local index, which in this 
case is a function with values in Z © Z2 . We also show in each setting that 
the group of values for the index (either Z or Z © Z2) is determined by 
the axioms. 

Finally, for the general case of coincidence theory for arbitrary pairs of 
maps between two manifolds we provide a set of axioms which charaterize 
the local Reidemeister trace which is an element of an abelian group which 
depends on the pair of functions. These results extend known results for 
coincidences between orientable differentiable manifolds. 

1 Introduction 

For two mappings f,g:M~^N, we say that a; G M is a coincidence point of 
/ and g when f{x) = g{x). In 1955, Schirmer (|15j) defined a local coincidence 
index in the setting where M and N are orientable manifolds of the same (finite) 
dimension. This coincidence index generalizes the well-known fixed point index, 
and functions as an algebraic multiplicity count for coincidence points. The 
index is integer valued, is invariant under homotopies of / and g, is additive on 
disjoint subsets, and is nonzero when / and g have a coincidence which cannot 
be removed by homotopy. 

The characterization of this type of functions has a long story. C. Watts 
in |18| characterized the Euler characteristic in an axiomatic way, using a very 
simple set of axioms. Using similar types of axioms, recently M. Arkowitz and 
R. Brown in 1 characterized the Lefschetz number of selfmaps. In the same 
spirit the first author and J. Weber characterized the equivariant Lefschetz 
number and the Reidemeister trace of selfmaps in . 
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Another concept which also plays a very important role is the concept of the 
"local fixed point index" , where now we have enlarged the domain where our 
function is defined. A characterization of this function in terms of axioms for 
finite polyhedra was given by B. O'Neill in [T3]. O'Neill's axioms later appeared 
in the book by R. Brown, [5]. For the differentiable case the problem was 
analyzed in [7]. For the related function, the local Reidemiester trace for fixed 
points, the problem was considered by the second author in [16] . 

Only very recently, in [T7], for differentiable orientable manifolds, the second 
author showed that the coincidence index is the unique integer- valued function 
which satisfies 3 axioms: additivity, homotopy invariance, and a normalization 
axiom stating that the total index taken over the whole domain space equals 
the coincidence Lefschetz number. This result used a direct generalization of 
the techniques in [7] by Furi, Pera, and Spadini. This work was then extended 
(still in the setting of differentiable orientable manifolds) to a uniqueness result 
for the Reidemeister trace for coincidences subject to 5 axioms in |16) . 

The goal of the present paper is to prove the uniqueness of the coincidence 
index and the Reidemeister trace subject to axioms similar to those in the above 
work (specifically [7], [17], and [16]), without using the differentiability or ori- 
entability assumptions. As we will see, dropping the differentiability assumption 
does little to change the character of the work, while orientation becomes the 
major point of focus. 

When both manifolds M and N are orientable we can choose an orientation 
for each manifold, and the index at a coincidence point x of maps / and g 
is defined in terms of the way / and g carry the orientation from x into the 
orientation at f{x) = g{x). When our spaces are not orientable, the lack of 
a consistent local orientation for all points of the coincidence set will render 
this approach problematic. In fact, it has been known for some time that there 
cannot be an integer valued function which behaves like the coincidence index 
in the setting of nonorientable manifolds. 

The situation is fairly well-behaved when one of the maps (say g) is orien- 
tation true: this means that for a loop 7 C M, the loop 7 preserves a local 
orientation if and only if g{'y) does. In this case, we show that there is in fact 
a way to consistently orient the coincidence set and to define an integer valued 
coincidence index. This index is proven to be unique subject to axioms similar 
to those used in [T] and [17] . 

Next we move to the general case, where neither map is assumed to be ori- 
entation true. In this case the difficulties in consistently orienting the spaces 
are not avoidable, and in some cases the index will not be integer- valued. In 
particular we divide the coincidence set into two types, nondegenerate and de- 
generate, depending on whether or not a sort of orientation true property holds 
locally. We will see that the nondegenerate coincidence points will have a coin- 
cidence index with value in Z, while the degenerate coincidence points will have 
an index in Z2 — Z/2Z. 

Thus in the case where neither map is assumed to be orientation true, our 
coincidence index will have its value in the group Z © Z2 . This index is proven 
to be unique subject to axioms similar to those used in the orientation true case. 
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The choice of the set of values for the index (either Z or Z © Z2) is not 
arbitrary. In fact we show that any index with values in an abelian group G 
which satisfies our axioms and and additional condition will in fact have values 
in a subgroup of G isomorphic to Z or Z © Z2 . 

One fundamental change in the character of the general case is that the index 
is somewhat less local. In particular the domain of the maps / and g becomes 
very important. It is possible, for example, to have maps f,g:M^N with 
open sets U C V d M such that the index of / and 5 on J7 is different from 
the index of /|y and g\v on U, where f\vig\v '■ V —J' N are the restrictions of 
/ and g to V . This can occur, for example, when g is not orientation true and 
M is nonorientable (so the index of / and <? is in Z © Z2 ) but V is orientable 
as a submanifold, with giV) contained in an orientable submanifold of A'' (so 
g\v is orientation true and the index of f\v and g\v is in Z). Because of this, 
we must keep a careful account of the domain of the maps, and the value of the 
index will depend on this domain. Our focus, therefore, will be on local maps, 
ones defined only on specific subsets of M. 

We also extend the result of [TB] , which is a uniqueness theorem for the Rei- 
demeister trace. We show that, assuming g is orientation true, the Reidemeister 
trace of maps / and g has value in ZTZ{f, g), (where TZ{f, g) is the set of Reide- 
meister classes), and is unique subject to axioms similar to those in |16| . In the 
general case (when neither map is orientation true), we prove the uniqueness 
of a Reidemeister trace with value in (Z © Z2)7^(/, 5). We further show that 
72.(/, g) splits as a disjoint union Tl{f,g) — 72.„(/, 5) UTZd{f,g) so that the value 
of the Reidemeister trace is always in ZTZn{f,g) © Z272.d(/, 5). 

We begin in Section[2]with a careful discussion of local orientations and prop- 
erties of orientation true maps. In Section [3] we give our axioms and uniqueness 
result in the case where g is orientation true. Section H] drops this assumption 
and gives axioms and a uniqueness result in the general case. In Section [5] we 
show that the group of values of the index must be (isomorphic to) Z or Z©Z2. 
The results concerning the Reidemeister trace follow in Section [HI The bulk of 
the paper concerns the uniqueness of the index in various settings with respect 
to various axiom schemes. We conclude with a brief appendix concerning the 
existence, much of which is already documented in the literature. 

2 Local orientations and orientation true maps 

We begin by discussing a suitable setting for the study of coincidences between 
manifolds independent of whether the manifolds are orientable or not. This 
setting is guided by the properties and knowledge we have about coincidence 
theory, in particular when the manifolds involved are not both orientable. For 
maps between two orientable manifolds, the coincidence theory has been well 
understood for some years (see [15]) and as part of the data we fix one orien- 
tation for the domain and one orientation for the target. We will extend this 
approach without assuming orientability in such a way that the procedure re- 
duces to the classical case if it happens that the two manifolds are orientable. 
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An intermediate situation is when the two manifolds are not necessarily ori- 
entable but we restrict to the class of pairs of maps where one of the maps is 
orientation-true. It is known that the coincidence theory for such pairs of maps 
has many similar properties to the case where the manifolds are orientable. 

2.1 Local orientations 

Let M be a path connected (or equivalently connected in our particular case) 
n-dimensional manifold. There is a unique local system of coefhcients with local 
group Z, which we call the "orientable bundle over M" , which exists whether or 
not the manifold is orientable. This local system is provided once at a chosen 
point xq G M we have the group Z and a representation 7ri(Af, zq) — ;> Aut{Z) 
(see [12] Ch. VI, section 1 theorems (1-11) and (1.12)). The representation is 
simply given by sending an element a G 7ri(Af, xq) to the automorphism of Z 
which is multiplication by sign(a). This sign is defined to be ±1 according to 
whether a local orientation is preserved or reversed when translated around the 
loop a. Observe that given an arbitrary point the transport of a local orientation 
along a path provides a concrete construction of the unique (up to isomorphism) 
bundle over M of the local system. 

Definition 1. The orientable bundle over M is the unique (up to isomorphism) 
bundle with local group Z determined by the representation 9 : 7ri(M, xq) — ^ 
Aut(Z) defined above where xq £ M. 

If the manifold is orientable then the representation described above is the 
trivial homomorphism, and if the manifold is not orientable the representation 
is non-trivial. In any case we have just one bundle. Now we define a local 
orientation at xq G Af as a chosen generator of the local group Hn{U, [/ — xq; Z) 
for some small neighborhood U oi Xq. This generator we identify with 1 of the 
local group Z at xq. Note that if M is path connected and orientable, then 
a choice of local orientation at a point is equivalent to a choice of a global 
orientation for M. 

For the purpose of coincidence theory, based on our knowledge in the case 
where the manifolds are orientable, we need to choose some kind of orienta- 
tion associated to the pair {M,N). For {xo,yo) G M x N, we have two local 
orientations at xq and two local orientations at yo. If we denote one local ori- 
entation at a point x by Ox then the other one we denote by —Ox- We say that 
two pairs {Oxo,Oy„), {0'^^,0'yj are equivalent if {Ox„,Oy„) = {aO'^^,aO'y^) for 
some cr G {-1-1,-1}. In this case we write [Ox„,Oyg] — [0^0,0^^]. So we have 
two equivalence classes at each pair of points {xq^ yo). Then we define: 

Definition 2. A local orientation for {M,N) at {xQ,yo) is a choice of one of 
these two classes defined above. 

2.2 Orientation-true maps and coherent orientations 

A map / : Af — > is orientation true when for any loop 7 in Af, we have 
sign(7) = sign(/(7)). 
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Here wc state some properties of orientation true maps whieh are used and 
we apply some concepts from the previous subsection to study coincidences of 
pairs where the second map is orientation true. 

First we show that the orientation true property is homotopy invariant. 

Lemma 3. // /, f : M ^ N are homotopic and f is orientation true, then f 

is orientation true. 

Proof. The induced homomorphisms : 7ri(M, a;o) — ^ 7ri{N,f{xo)) and : 
7ri(M, xo) TTi{N, f'{xoj) satisfy = 9f^6~^, where ^ is a path from f{xo) 
to f'{xo). This imphes that for every a G 7ri(M, a;o) we have 

sign(/#(a)) = sign(6» * /#(a) * 6»-^) = sign(6i * 6''^) sign{f^{a)) = sign{f^{a)) 

and the result follows. □ 

Now let us consider a pair of maps (/, g) from M to N. For any open set U C 
M, let Coinif, g,U) = {xGU\ f{x) = g{x)}, and Coin(/,5) = Coin(/, g, M). 

For a path A from o to 6 and a local orientation O at o, let A(0) be the 
orientation at b given by transport of O along A. Let xq,xi e Coin(/, g), and 
let jji = f{xi) = g{xi). Let Ox^ be a local orientation at Xi, and similarly Oj,. be 
a local orientation at j/j. We say that [Oxo,Oy^] and [Oxi,Oy^] are g-coherent 
when there is a path A from xq to xi with [Oxi,Oy^] = [X{Oxo), g{X){Oyo)]. The 
following shows that, when g is orientation true, this formula will hold for any 
path from xq to xi. 

Lemma 4. When [Ox„,Oy„] and [Ox^^Oyj^] are g-coherent and g is orientation 
true, we have [Oxi,Oy^] = hiOxJ, g{'y)iOyg)] for any path 7 from xq to xi. 

Proof. Since [O^q, Oyo] ^-i^cL [Ox^^Oy^] are g-coherent, there is a path A from xq 
to xi with [OxnOy^] = [A(02;„), g(A)(0.y„)]. Now let 7 be another path from xq 
to xi. We will show that [X{Ox,),g{\){Oy,)] = biOx„).g{i){Oy,)]. 

Let CT = ±1 be the sign such that A(Oa;o) = cr^iiOxa), so that a = sign(7 * 
A~^). Since g is orientation true this means a = sign(5(7) * g{\^^)) = 1, which 
implies that g(A)(OyJ = (Jg{l){Oy^). Thus we have (A(Oa;J, gr(A)(Oj,J) = 
(o-7(Oxo),cr5(7)(Oyo)) which means that [A(O^J, 5(A)(OyJ] = b{Oxo),g{l){Oy^)] 

□ 

Let C{f,g) = {{x,y) | f{x) = g{x) = y}. 

Definition 5. A map 0(a;,y) = [Ox,Oy\ which gives a class of pairs of local 
orientations at points [x.y) G C{f,g) for which 0(.To,yo) is 5-coherent with 
0{xi,yi) for all {xi,yi) G C{f,g) is called a g-coherent orientation ofC{f,g). 

Given a point {xo,yo) £ C{f,g) with g orientation true, we can spec- 
ify a (7-coherent orientation O of C{f,g) by choosing a specific orientation 
for O(a;o,?yo) = [OxojOyg] (there are two possible choices), and then defining 
0{xi,yi) to be [X{Oxo), g{X){Oyf^)], where A is a path from xq to Xi. This O 
will be well defined (will not depend on choice of A) by the above lemma. Since 
there are two possible values for O{xo, yo), we have: 



5 



Proposition 6. When g is orientation true, there are exactly two possible g- 
coherent orientations of C{f, g). These are each uniquely determined by their 
value at a single point. 

When we have homotopies f — f and g ^ g' and a g-coherent orientation 
O of C (/,(?), there is a naturally related choice of a g'-coherent orientation O' 
of C{f',g'). Let {x,y) e C{f,g) and (x'.y') G Cif.g'), and let 0{x,y) = 
[Ox,Oy]. If 7 is a path from x to x' and G is the homotopy of g to g' , then let 

7G([O.,O,]) = [7(Ox),G(7(t),0(O,)]. 

Definition 7. Let O and O' be g- (and g'- respectively) coherent orientations 
of C(/, (?) and C{f',g') with f ^ f and g ~ g' , and let G be the homotopy of 
g to g' . We say that O' is G-related to O when there are {x,y) £ C{f,g) and 
{x', y') e C(/',5') with a path 7 from x to x' and 0'(x', y') = 70(0(2;, y)). 

Such an orientation O' is in fact unique: 

Lemma 8. Let O be a g-coherent orientation ofC{f,g) with g orientation true, 
with f — f and g ~ g' , and let G be the homotopy of g to g' . Then there is a 
unique orientation 0'{x,y) of C{f' , g') which is G-related to O. 

In the proof we make repeated use of the following fact, which is an exercise: 

Proposition 9. If G is a homotopy from g to g' and a is a path from x to x' , 
then G{a(t),t) is a path from g{x) to g'{x') and 

G{a{t), t) ~ g{a) * G{x' ,t) ~ G{x, t) * g'{a). 

Proof of Lemma\^ Choose some {x,y) £ C{f,g) and {x',y') G C{f',g'). Mak- 
ing the definition 0'(x', y') = 70(0(3:, y)) suffices to define O' on all of C(/', g') 
by Proposition [51 For the uniqueness, it suffices to show that this construction 
of O' does not depend on the choice of 7 or on the choice of the points x, x' , y, y' . 

First we show that O' is independent of the choice of path 7. Let 7 be an 
alternative choice of path from x to a:'. Let 0(a;, y) = [Ox, Oy\. Our goal is to 
show that 

[-l{0x),G{^{t),t){0y)] = [^{Ox),Gm),t)(Oy)]. 

Let cr = ±1 be the sign such that G{-i{t),t){Oy) = aG{j{t),t){Oy). Then 
since transports along homotopic paths are equal, Proposition|9]gives G{'^{t),t){Oy) — 
(7(7) * G{x' ,t){Oy) and similarly with 7. Thus we have 

5(7) * G{x', t){Oy) = ag{^) * G{x' , t){Oy), 

and so cr = sign(g(7^^) * 5(7))- Since g is orientation true this means u = 
sign(7~^ * 7), which means 7(0^) = o-l{Ox)- Thus we have 

{^{Ox),G{^{t),t){Oy)) = {a^{Ox),aGm),t){Oy)), 

which completes the argument. 
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Now we show that O' does not depend on the choice of points x,y,x',y'. 
Our orientation O' was constructed by starting with 0{x,y) and carrying this 
orientation through G on the path 7 to an orientation at {x',y'). 

Let {x,y) e C(/, g) and {x',y') G C{f\g'), and we wiU construct an ori- 
entation O' of €.{f',g') by starting with 0{x,y) and carrying this orientation 
through G to {x' , y'). Then we must show that O' = O'. This we do by showing 
that they agree at the point {x',y'). 

In our construction above, we have 0'{x\y') = [j{Ox),G{j{t),t){Oy)]. Let 
A' be a path from x' to x' , and then by coherence of O' we have 

0'(x',y') = [A'(7(0.)),5'(A')(G(7W,t)(0,))] 

= [(7*A')(0.),(G(7W,t)*5'(A'))(0,))]. (1) 

For 0'{x',y'), we start with 0{x,y) = [X{Ox), g{X){Oy)], where A is a path 
from X to X. Let 7 ~ A^^ * 7 * A', this is a path from x to x' . Then carrying 
[\{0x),g{y){0y)] through G along 7 gives 

&{x',y') = [7(A(0,)),G(7W,i)(5(A)(0,))] 

-[(A*7)(O,),(.9(A)*G(7(t),0)(O,))] 

= [(7*A')(0.),(.9(A)*G(7W,t))(0,))]. (2) 

To show equahty of ^ and © it suffices to show that the paths G{'j{t),t) * 
g'{X') and g{X) * G{'^{t),t) are homotopic. Using Proposition |9] repeatedly gives 

5(A) * G{^{t),t) ^ 5(A) * 5(7) * G{x', t) ~ 5(A * 7) * G{x' , t) 
^ 5(7 * A') * G{x', t) ~ G{x, t) * 5'(7 * A') 
c G(x, t) * 5' (7) * 5'(A') c G(7(t), * 5'(A') 

as desired. 

□ 

When f,g:M—^M are selfmaps of orientable manifolds, we can relate the 
local orientations at points in the domain to the local orientations at points in 
the codomain. 

Definition 10. Let /, 5 : M M and let O be a 5-coherent orientation of 
'^{fj 9)- We say that O is oriented consistently if, given any point (x, y) G C(/, 5) 
with 0{x,y) = [Ox,Oy], we have A(Oa;) — Oy for any (and thus every) path A 
from X to y. 

Intuitively this indicates that the orientation chosen in the domain space is 
the same as that chosen in the codomain space. If C(/, 5) consists of a single 
point {x, x), then O is oriented consistently if and only if 0(x, x) — [Ox, Ox] for 
some local orientation Ox at x. 

Definition 11. For a homeomorphism h : U C M N with a point x E U 
and local orientations Ox,0^x), define sign(/i, [Ox, O^x)]) to be +1 if h^{Ox) = 
Oh(x), and —1 otherwise. 
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Note that this sign is weh defined with respect to the two representations 
of the equivalence class [Ox,Oh{x)]- Also note that when ft. is a diffeomorphism 
ft : M" and Ox and O^i^x) are the standard orientations of R", then 

sign(ft, [Ox,Oh{x)]) = sign(det(dft^)). 

3 The index for pairs of maps where one of the 
maps is orientation-true 

To give our coincidence index a truly local setting, we will consider only local 
maps. A local map / of M — >■ A'' is a continuous map whose domain dom/ 
is an open subset of M, and whose image is in N. Note that all results of the 
previous section concerning orientations apply to pairs of local maps which have 
the same connected domain. 

3.1 Pairs of maps where the second is orientation true 

The coincidence index in this subsection will be defined on the following set: 

Definition 12. Let C be the set of all tuples {f,g,U,0), where f,g are local 
maps of Af —^-N for some manifolds M and A^ of the same dimension, the 
domains of / and g are the same connected set, the set ?7 C M is an open subset 
of the domain of / and the set Coin(/, g, U) is compact, g is orientation true, 
and O is a g-coherent orientation of C{f,g). 

Note that for {f,g,U,0) € C with U C M, we do not necessarily assume 
that / and g are restrictions of globally defined functions f,g:M—^N. In 
fact, in this section, the local index will not depend on whether or not there 
exist such extensions /, g. Further, as long as g remains orientation true, the 
local index will be the same for the tuples (/, g, U, O) and (/, g, U, O) where O 
is the appropriate extension of O. 

The set C is called the set of admissible tuples. We say that a pair of homo- 
topies F, G : (dom/) x [0,1] A^ is admissible when Coin(F, G, J7 x [0,1]) is 
compact inU X [0, 1] . We say that two tuples (/, g, U, O), (/', g', U, O') E C are 
admissably homotopic if there is a pair of admissible homotopies taking / to /' 
and g to g' and O' is G-related to O, where G is the honiotopy between g and 
9'- 

Our main result is that there is at most one function t : C — s> M satisfying 
the following axioms (compare to the axioms of and [T7]): 

Axiom 13 (Additivity axiom). Given (/, g, [/, O) G C, if Ui and U2 are disjoint 
open subsets of U with Coin(/, 5, U) d Ui U U2, then 

i{f,g,U,0) = i{f,g,Ui,0) + i{f,g,U2,0). 

Axiom 14 (Homotopy axiom). If {f,g,U,<Q) e C and (/', 5', [/, O') G C are 
admissibly homotopic, then 

Lif,g,U,0) = Lif',g',U,0'). 
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Axiom 15 (Normalization axiom). Let (c, g, U,<0) E C with c\u a constant map 
with constant value c and g\u an embedding with g{x) = c. If sign{g,0{x, c)) = 
1, then 

i(c,(7,{/,0)-l. 

One useful property follows immediately from the additivity axiom: 

Proposition 16 (Excision property). Let l : C ^ M. satisfy the Additivity 
axiom. Let {f,g, U,0) E C and let U' d U be an open set with Coin(/, U) C 
U'. Then 

A(/,g,C/,0) = i(/,g,C/',0). 

Proof. Applying the Additivity axiom to the disjoint union Coin(/, 0) C U 
gives 

.(/,g,0,O) + .(/,g,0,O) = t(/,5,0,O), 

and so t(/,g,0,O) = 0. 

The excision property follows from the Additivity axiom applied to the union 
Coin(/, g, [/) C [/' U 0, which gives 

i{f, g, U, O) = i{f, g, U', O) + i(/, g, 0, 0) = t(/, .g, U' , O). □ 

Let Cr" be the set of admissable tuples {f,g,U,0) of maps whose domain 
and codomain are subsets of K", and O is consistently oriented. From Lemmas 
11 and 12 of [161 , the coincidence index is unique on Cr^ subject to additivity 
and homotopy axioms formulated similarly to ours, and a "weak normalization" 
axiom stating that the index of a constant map with the identity map is 1. (The 
requirement that the orientation be consistently oriented is implicit in [16]: a 
single orientation on M" is fixed throughout the paper, making it impossible in 
the setting of maps M" — s> M" to choose different orientations in the domain and 
codomain.) 

Let ind : Cr" K denote this unique coincidence index for R" . If t satisfies 
our three axioms, then the restriction of l to Cri. satisfies the three axioms of [IB] 
(our Normalization axiom implies the weak normalization axiom when restricted 
to Cr. ) and we have i(/, g, U, O) = ind(/, g, U, O) when (/, g, U, O) G Cr. . 

Next we show that if l satisfies our three axioms, then its value on a euclidean 
neighborhood of a single coincidence point agrees with ind when we move the 
setting into M" by applying charts. 

Lemma 17. Let (f,g,U,0) £ C with Com{ f , g,U) consisting of a single coin- 
cidence point X such that U is a euclidean neighborhood of x and f(U) U g(U) is 
contained in a euclidean neighborhood W of y — f{x) = g{x). Let j : U ^ R" 
and h : W R" be homeomorphisms, and let f — ho foj^^ and g = ho go j^^ . 

LetO{x,y) — [Ox,Oy], and define an orientation Oi ofC{f,g) by 0{j (x) , h{y)) — 
[j*{Ox), h,:{Oy)]. If O is oriented consistently, and l satisfies the three axioms, 
then 

t(/,5,f/,O) = ind(/,5,R",0)). 
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Proof. Throughout, we wih use the bar to indicate apphcation of j and h ap- 
propriately as in the definitions of f,g, and O. Let U C C he the set of aU 
tuples {s,t,Z,A) with Z C U and A oriented consistently. Then there is a 
bijection lu : 14 ^ Cri. given by u!{s,t, Z, A) ~ {s,t,j{Z),A), and so we have a 
map i o u!~^ : Ck^ — )• JR. 

We now note that t o uj~^ satisfies the homotopy, additivity, and weak nor- 
malization axioms of |16| , and thus is equal to ind, the unique coincidence index 
on Cffin . The homotopy and additivity axioms are clear, but the weak normal- 
ization axiom deserves some comment. 

We must show that l o uj~^{c, id, K", B) = 1 where c is a constant map with 
constant value c S M", and B is oriented consistently. From the definition of w 
we have 

w^^(c,id,M",B) = (/i^^ oco j,h-^ o j,U,A), 

where A = B. The tuple on the right above has j^^(c) as its only coincidence 
point, with common value h~^{c). The first map is a constant and the second 
is an embedding, so the Normalization axiom will apply to show that o 
c o o j, U, A) = 1, provided that sign(/i~-^ o j, A(j~^(c), h~^{c)) = 1. 

Let A{j^^{c), h^^{c)) — [Oj-i(c), 0/i-i(c)], and we will show that {h^^ o 
j)*Oj-i(c) = Oft,-i(c)5 and thus the above sign is 1. Since A = B, we have 
B(c, c) = [j*(Oj-i(c)), and since B is oriented consistently this 
means j*{Oj-i(c)) — h*{Oh-^{c))- Now we compute 

{.h-^oJ),{OJ-^^,)) = K\MOj-iic))) = K\K{Oh-^(c))) = o^-^,) 

as desired. 

We have shown that t o a;~^ : Ck^ — )> M satisfies the three axioms of [16], 
and thus it equals ind, the unique coincidence index on R". Thus we have 
i{f,g,U,0) = indoc^(/,g,[/,0) - md{f,g,j{U),0) as desired. □ 

For our uniqueness theorem, we will make use of Lemma 15 from |17) . show- 
ing that our tuples may be changed by admissible homotopy to have isolated 
coincidences: 

Lemma 18. Let (/,(;,[/, O) € C, and let V G U be an open subset containing 
Coin(/, [/) with compact closure V C U . Then {f,g,V,0) is admissably ho- 
motopic to some {f , g' ,V,0') , where f and g' have isolated coincidence points 
in V. 

Our strategy for the main result is to change the maps by homotopy, first 
so that they have isolated coincidence points, and then use charts and Lemma 
1171 to determine the index. 

Theorem 19. There is at most one function l : C ^ M. which satisfies the 
axioms. 

Proof. Let (/, g, U, O) G C, and let t : C — >■ M satisfy the axioms. By the 
Homotopy axiom and Lemma I18[ we may assume without loss of generality 
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that Coin(/, g, U) is a finite set of isolated coincidence points. For each such 
point X, let Ux be a neighborhood of x containing no other coincidences. Then 
by the additivity axiom we have 

xeCoin(f,g,U) 

Take a particular coincidence point x G Coin(/, [/), and we wih show 
that the axioms alone determine the value of L{f,g,Ux,'0). Let y — f{x) = 
g{x), and let 0{x,y) = [Ox,Oy]. Since Com{f,g,Ux) is a single coincidence 
point, we may shrink Ux by the excision property and assume that there is 
a euclidean neighborhood Wx containing f{Ux) L) g{Ux) and homeomorphisms 
/i : t/^, — > M" and j : Wx — > R" with h{x) = j{y) = 0. Furthermore we may 
assume (perhaps by composing with an orientation reversing selfmap of M") 
that h^,{Ox) — j*{Oy) — Oq, where Oa is the standard local orientation of R" 
at the origin. Let fx = j ° f ° h and (jx = j o g o h, and define O as in Lemma 
[T71 and we have 

t(/,g,C/,,0) =ind(/,,5,,M",0). 

Thus the value of L{f,g,Ux,0) is unique, and summing over x shows that 
5,f7, 0) is unique. □ 

The proof above immediately leads to some corollaries. First, note that t 
is computed as a sum of certain values of the classical coincidence index ind. 
Since this index is integer valued, we have: 

Corollary 20. Any function t : C — )■ M satisfying the axioms will have values 
in Z. 

Note that if we interchange the roles of / and g (provided that both are 
orientation true and O is both /- and (^-coherent) the value of l will be computed 
as 

i(g, /,[/,©)= J2 ind(ff.,/.,M",0). 

a;eCoin(/,g) 

A well-known formula for the coincidence index for orientable manifolds (in this 
case, it is just the Lefschetz number) gives ind{gx, /a;, K", O) — (—1)" ind{fx,gx, R' 
and thus we have 

Corollary 21. Let /, : C — >■ R satisfy the axioms, and let (/,(;,[/, O) G C such 
that {g, /, U, O) is also in C. Then 

.(/,.g,;7,0)-(-l)"t(.9,/,(7,0). 

Another corollary which we can obtain from the proof of Theorem [11] is 
that the value of l does not depend on the domain of the maps. The value of 
i(/, g, U, O) depends only on the local behavior of / and g near the coincidence 
points. Thus we have the following, referred to in [7, as the "Localization 
property" . 
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Corollary 22 (Localization property). Let {f,g,U,0) G C with dom/ = 
domg = V, and let {f\wig\w,U,0\w) E C be the tuple of the restrictions 
to an open connected set W with U C W C V . ///,:C— >R satisfies the axioms, 
then 

tif,g,U,0)^L{f\w,g\w,U,0\w). 

We point out the above specifically because the Localization property will 
no longer hold when we drop the orientation true assumption. 

Recall by Proposition [6] that there are exactly two orientations of C{f,g) 
when g is orientation true. If O is one such orientation, let — O be the other 
one. By the proof above, the value of t is computed using Lemma ll7[ and the 
value depends on the classical coincidence index on R". It is not hard to check 
that changing O to — O has the effect of reversing the sign of this value. Thus 
we have 

Corollary 23. If l satisfies the axioms, then 

L{f,g,U,0) = -Lif,g,U,^0). 
That is, the absolute value of l does not depend on the choice of orientation O. 

3.2 The case where at least one map is orientation true 

In the construction of our set C of tuples, we always require the second map to 
be orientation true. This is merely a convention, and in this section we briefly 
discuss the case where the first map, rather than the second, is assumed to be 
orientation true, and the general setting where at least one map (either one) is 
orientation true. 

Let C be the set of tuples (/, g,U,0) where Coin(/, g,U) is compact, / is ori- 
entation true, and O is a /-coherent orientation of C(/, g). That is, (/, g, U, O) G 
C if and only if (g, /, [/, O) G C. We say that (/, g, U, O), (/', g' , U, O') G C are 
admissably homotopic when there are admissible homotopies of / to /' and g 
to g' and O' is F- related to O, where F is the homotopy from / to /'. 

Our Additivity and Homotopy axioms in this setting are exactly the same 
as for C, but the normalization must change. Our uniqueness result is: 

Theorem 24. There is at most one function l' : C W satisfying three axioms: 

• (Additivity) Given (/, g, U, O) G C , if Ui and U2 are disjoint open subsets 
ofU with Coin(/,5,f/) C C/i U U2, then 

i'if, g, U, O) = i'if, g, C/i, O) + t'(/, .9, (Ja, O). 

• (Homotopy) If {f,g,U,0) G C and (/', 5', [/, O') G C are admissably 
homotopic, then 

i'{f,g,U,0) = L'if',g',U,0'). 
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• (Normalization) Let (/, c, U, O) € C with c\u a constant map with constant 
value c and f\ij an embedding with f{x) = c. // sign(/, 0(a;, c)) = 1, then 

i'{f,c,u,o) = {-ir. 

Proof. Let t' satisfy the three axioms, and define i : C — M by g, U, O) = 
(— /, U, O). This function t satisfies the axioms of the previous section 
for maps C — >■ R, and thus must be unique, and this specifies uniquely the 
function i'. □ 

We thus have two functions, l and t', purporting to be the unique coinci- 
dence index on the two sets C and C By the proof above we have g, U, O) = 

/, t/, O), and by CorollaryEB if (/, g, U, O) £ CnC we have g, U, O) = 
/, U, O). Thus we have 

Theorem 25. Let /, : C — > M and t' : C — ?► M satisfy their respective axiom 
schemes, and let (/, g,U,0) £ C nC . Then 

L{f,g,U,0)^L'if,g,U,0). 

Since l and l' agree on the intersection of their domains, we actually have 
a unique index defined on the class C = C U C oi all tuples where at least one 
map is orientation true and the orientation is appropriately coherent. 

Corollary 26. There is at most one function t : C ^ M. satisfying the axioms: 

• (Additivity) Given (/, (?,[/, O) G C, if Ui and U2 are disjoint open subsets 
of U with Coin(/,5, U) dUiU U2, then 

tif, g, U, O) = tif, g, C/i, O) + £(/, g, C/2, 0). 

• (Homotopy) If {f,g,U,0) £ C and (/', g', [/, O') £ C are admissably ho- 
motopic (either as elements of C orC), then 

L{f,g,U,0)^L{f',g\U,0'). 

• (Normalization) Let c\ij be a constant map with constant value c and f\u 
an embedding with f{x) ~ c and sign(/, 0(a;, c)) = 1. Then: 

l{c, /, [/, O) = 1 for (c, /, [/, O) £ C, and 
t{f, c, U, O) = (-1)" for if, c, U, O) £ C. 

4 The case of arbitrary maps between arbitrary 
manifolds without boundary 

Now we attempt to mimic the definitions and arguments of the previous section 
without the assumption that one map is orientation true. 
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4.1 Local orientations in the general case 

We begin as in the orientation-true case by discussing coincidence sets and their 
local orientations. 

Definition 27. Let Vq be the set of all tuples (/,(?, C/, V), where f,g are local 
maps oi M N with connected domain V , the spaces M and N are manifolds 
without boundary of the same dimension, the set U is an open subset of V , and 
Coin(/, g, U) is compact. 

Though the local maps /, g implicitly carry their domain, we include the set 
V in our tuples for emphasis to distinguish the setting from that the previous 
section. The fundamental difference in the non-orientation true case is that the 
index will depend on the domain set V . When one map is orientation true, this 
is not the case by the Localization property. Without the assumption that g 
be orientation true, it is possible when C ^ for the tuples {f\wi 9\wi U, W), 
{f,g, U, V) to have different values for the coincidence index. 

To emphasise the importance of the domain set V for a tuple {f,g,U,V), 
we will write C{f,g) — C{f,g,V). Next we define the concept of degener- 
ate and nondegenerate coincidence points of a tuple. We say that a coinci- 
dence {x,y) € <C{f,g,V) is degenerate when there is a loop 9 G 7ri(y, a:) with 
fi^{9) ~ g#{0) and sign(^?) ^ s\g'\i{g^{d)). Otherwise, we say that {x^y) is non- 
degenerate. Sometimes we will refer to a coincidence point x e Coin(/, g, U) as 
being degenerate or nondegenerate according to the degeneracy of {x,y). Note 
that when g is orientation true, all coincidences are nondegenerate. 

Let Cd(/, (7, C C{f,g,V) be the set of degenerate coincidences, and 
^n{f,g,V) C C{f,g,V) be the nondegenerate coincidences. This partitioning 
into degenerate and nondegenerate coincidences depends strongly on the do- 
main: when W cV,we haveCd{f\w,g\w,W) c Cd(/,g,^) and C„(/,g,T/) C 
Cn{f\w,g\w,W). 

When g is not assumed to be orientation true, the coherence condition for 
orientations at points of Coin(/, g, U) is not as well behaved as in Subsection 
12.21 Two orientations [Ox^ Oy\ and [Ox' , Oyi] may be g-coherent with respect to 
some paths from x to x' , but not with respect to others. We will see, however, a 
weaker notion of coherence can be used among the nondegenerate coincidences. 

For (/, 5, U, V) e 2?0j given two coincidence points xq, Xi G Coin(/, g, U), we 
say they are in the same coincidence class if there is a path 7 in y from xq to 
xi with /(7) ~ 3(7)- Such a path we will call a Nielsen path. 

Let {xo, 2/0)7 (2^1, 2/1) G C„(/, g, V), with xq,xi in the same coincidence class, 
and let Oxi, Oy- be local orientations at Xi and y^. Then we say that [O^,,, O^q] 
and [Ox^Oy-^] are Nielsen coherent when there is a Nielsen path 7 from xq to 
XI with [0.,,0,J = [7(0. J, /(7) (0,0)] = [7(O.J,5(7)(Oyo)]- 

A Nielsen coherent orientation of C(/, g, V) is a function 0{x, y) = [Ox, Oy] 
for which (D)(a;o,2/o) and C!)(xi,?/i) are Nielsen coherent when xq and xi are in 
the same coincidence class. 

If g is orientation true and O is 5-coherent, then all coincidences are nonde- 
generate and by Lemma|3]0 will be Nielsen coherent. Thus Nielsen coherence of 
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an orientation is weaker than g-coherence when g is orientation true. A weaker 
form of Lemma |4] will hold for Nielsen coherence within coincidence classes. 

Lemma 28. When Xq,Xi are nondegenerate coincidence points of a tuple 
{f,g,U,V) G 2?o in the same coincidence class and [Oxa^Oy^^] and [Oxi^^Oy^] are 
Nielsen coherent, we have [Oxi,Oy^] = h{Oxo), g{j){Oyo)] = h{Oxo), filYiOyo)] 
for any Nielsen path 7 from xq to xi . 

Proof. Let 7 be another Nielsen path from xq to xi, and let 6* = 7 * 7"^. The 
proof of Lemma 0] will apply provided that sign0 = sign g{6). Since 7 and 7 
are both Nielsen paths we will have f{9) ~ g{0), and thus since xq and xi are 
nondegenerate we have sign0 = sign 5(0) — sign f {9) as desired. □ 

Thus a Nielsen coherent orientation is uniquely determined once we specify 
its value at one point from each coincidence class. 

Our present setting requires a modified form of homotopy-relatedness. 

Let O be a Nielsen coherent orientation of C{f,g, V) associated to the tuple 
(/, g, U, V), and O' be a Nielsen coherent orientation of C(/', 5', V) with f' — f 
and g' 2i g. Let F and G be the homotopies taking / to /' and g to g'. Recall 
that if {x, y) £ C(/, 5, V) and (a;', y') 6 C(/', 5', V) and 7 is a path in V from x 
to x' , then 

7G(0(x,y)) =7g([0.,0,]) = MOx),Gi^it),t)iOy)] 
is an orientation at {x' , y'). 

Definition 29. Let {f,g,U,V) S Vq, and let O be a Nielsen coherent orienta- 
tion of C{f,g, V) and O' be a Nielsen coherent orientation of C{f',g' , V) with 
f' — f and g' ~ g. Let F and G be the homotopies taking / to /' and g to g' . 

We say that O' is (F,G)-related to O if: whenever {x,y) G Cnif,g,V) and 
{x',y') G Cn{f',g', V) with a path 7 from x to x' in V such that F{j{t),t) = 
G(7(i),i), we have 0'ix',y') = 7^(0(0;, y)) = 7g(0(x,2/)). 

This notion of relatedness is weaker than G-relatedness as defined in Defi- 
nition [71 Specifically, when g is orientation true and O is (7-coherent and O' is 
g'-coherent, then if O and O' are G- related, they are automatically F, G- related. 

Lemma 30. As described above, F, G-relatedness is well defined. That is, it 
does not depend on the choice of path 7. 

Proof. Let O be a Nielsen coherent orientation of Coin(/, and let O' 

be a Nielsen coherent orientation of Com{f',g',V) which is F, G-related to 
O. Say that we have points {x,y) G Cn{f,g,V) with 0{x,y) — [Ox,Oy] 
and {x',y') G C„(/',g',F) with a path ^{t) in M from x to x' such that 
F{-i{t), t) = G{-/(t),t) for aU t, and then by F, G-relatedness we have 0'{x', y') = 
[7(0,),G(7W,i)(0,)]. 

Let 7 be another path from x to x' with F{'j{t),t) — G{'j{t),t), and let O' 
be the same as O', except using 7 instead of 7 to define 0'(x', y'). We will show 
that 6'{x',y') ^0'{x',y'). 
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The proof of the corresponding statement from Lemma |S] uses the fact that g 
is orientation true on the loop 7 * The same proof will work here provided 
that we show sign(7 * 7""'^) = sign(g(7 * j^^)). 

Let A = 7 * 7""'^, and using Proposition 1^] gives 



/(A) = /(7) * fir') - f{l) * F{x', t) * t)-' * /(7)-^ 
^F{^{t),t)*Fm),t)-\ 

Similarly g{\) ~ G{-i{t),t) * G(7(i),t)"\ and so /(A) ~ .g(A), which is to 
say /#(A) — 5#(A). Since A is a loop at x and (x, y) G Cn{f,g), we have 



Note that wc will not expect an analogue to Lemma HI if we have a ge- 
ometrically inessential coincidence class C of {f',g') which is related by the 
homotopies to an empty coincidence class of {f,g), then the points in C can 
be assigned either orientation without violating the {F, G)-relatedness criterion. 
Note that these choices of orientations would not effect the index, because the 
class is geometrically inessential. 

4.2 Axioms and uniqueness 

We begin this subsection defining the tuples for which we will associate an index. 

Definition 31. Let V be the set of all tuples (/, g, U, V, O), where (/, g, U, V) e 
T>o and O is a Nielsen coherent orientation of C{f,g, V). 

We say that two tuples (/, g, C/, O), (/', 5', [/, V^, O') £ V are admissibly 
homotopic if there is a pair of admissible (in the sense of Section [3|) homotopies 
F, G taking / to /' and g to g' and O' is F, G-related to O. 

Throughout this section we consider functions l : 2? — !> R © Z2 . Our main 
result is that there is a unique such function satisfying certain axioms similar to 
those used in the previous section. The axioms for this section take the following 
form: 

Axiom 32 (Additivity axiom). Given {f,g,U,V,0) G V, if Ui and U2 are 

disjoint open subsets of U with Coin(/, g, U) (Z Ui U U2, then 



Axiom 33 (Homotopy axiom). // (/, 5, [/, O) G V and {f\g\U,V,0') G V 
are admissably homotopic, then 



Axiom 34 (Normalization axiom). Let {c, g,U,V,0) G V with c\u : U ^ N a 
constant map g\ij : U N an embedding with g{x) = c and sign{g, 0{x, c)) = 1. 



sign(A) = sign{g{X)) as desired. 



□ 



.(/, 5, U, V, O) = i{f, g, Ui, V, O) + i{f, 5, U2, V, O). 



i{f,g,U,V,0) = L{f',g',U,V,0'). 



Then 




tf{x,c)eCM,g,M), 
tf{x,c)eCd{f,g,M). 
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Exactly as in Section [3] we obtain an excision property. 

Proposition 35 (Excision property). Let l : C ^ M. satisfy the Additivity 
axiom. Let (/, g, U, V,0) G C and let U' d U be an open set with Coin(/, g, U) C 
U'. Then 

L{f,g,U,V,0) = iif,g,U',V,0). 

The proof of the uniqueness in this section is similar to that in the previous 
section. The analogue of Lemma [T7] is that the index at a single nondegenerate 
coincidence point agrees with ind (the unique coincidence index for selfmaps of 
R") when we compose with charts. 

Lemma 36. Let (/, [/, V, O) £ D with Coin(/, [/) consisting of a single 
nondegenerate coincidence point x such that U is a euclidean neighborhood of x 
and f(U)Ug{U) is contained in a euclidean neighborhood W ofy = f{x) ~ g{x). 
Let j : U ^ R" and h :W ^ R" he homeomorphisms, and let f — h o f o 
and g = ho g o j^^ . 

LetO{x,y) = [Ox,Oy], and define an orientation O ofC{f,g) by 0{j (x) , h{y)) = 
[j*iOx),h^{Oy)]. If O is oriented consistently, and i satisfies the three axioms, 
then 

.(/,g,C/,V-,0) = ind(/,5,R",0). 

Proof. The proof is almost identical to that of Lemma [T71 We will highlight the 
relevant changes. 

Let U CVhe the set of all tuples {s,t,W,V,k) with W C U and A oriented 
consistently. Then there is a bijection uj : U Cr.> given by uj{s, t, W, V, A) = 
(s, t,j{W),A), and so we have a map louj^^ : Ce^ R. 

As in the proof of LemmafTTl the proof is complete when we show that lou^^ 
satisfies the additivity, homotopy, and weak normalization axioms of T-6 . Addi- 
tivity and homotopy are clear, and the demonstration of the weak normalization 
axiom from the proof of Lemma [T7] also applies in this case, though the usage 
of the Normalization Axiom is only valid if x is nondegenerate. We have as- 
sumed this nondegeneracy as a hypothesis, so the proof carries without further 
changes. □ 

Our uniqueness proof for this section follows the proof of Theorem I19| but 
requires some extra argument for the degenerate coincidence points. 

Theorem 37. There is at most one function t : 2? R © Z2 which satisfies the 
additivity, homotopy, and normalization axioms. 

Proof. Let (/, g, U, V, O) S V, and let i satisfy the axioms. As in the proof of 
Theorem [T9l we assume that Coin(/, g, U) is a set of isolated coincidence points. 
For each x 6 Coin(/, 5, J7), let Ux be a euclidean neighborhood of x so that 
f{Ux) yJg{Ux) is contained in a euclidean neighborhood Wx oiy — f{x) — g{x), 
and we have 

L{f,g,u,v,n) ^Y.'^^^9.Ux,v,n). 
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When (x, y) G C„(/, g, V) the value of (.(/, g, Ux,V, O) is determined uniquely 
by Lemma [36l Thus we need only show that L{f,g,Ux,V,0) is unique for 
{x,y) e Cd{f,g,V). This we do by showing that our pair of maps can be 
changed by admissable homotopies so that locally they consist of a constant 
and an embedding. Then the Normalization Axiom gives a unique value for the 
index. (Actually, the following argument will work whether (x, y) is degenerate 
or not.) 

Let j : Ux ^ M" and h : Wx — >■ K" be embeddings, and let f — h o f o j^^ 
and g — h o g o j^^ . By transversality arguments, we may change / and g to 
maps /' and g' by admissible homotopies so that: /' and g' are smooth, have 
finitely many coincidence points, and each coincidence point z G Coin(/',g') 
is regular in the sense that dg'^ — df'^ (the difference of the derivatives at x) is 
nonsingular. Further, we can choose the homotopies to be sufficiently small so 
that each coincidence point z e Com{f' ,g' ,Ux) is degenerate. 

To simplify the argument, we assume that Co'm{f' ,g') is a single point z. 
(If there are more coincidences we isolate them with neighborhoods and use 
excision.) By excision and the nonsingularity of the derivatives, we may assume 
that U is suffiently small so that g' — /' is a homeomorphism 

Being a selfmap of R", the map /' is homotopic to the constant map at 0, 
and so g' — f is homotopic to g'. In fact this homotopy is admissable: Let 
F{z,t) = (1 — t)f'[z) be the homotopy of /' to 0, and then the homotopy 
g\z, t) = g'{z) - F{z, 1 - <) is a homotopy of g' to 5' - /' with Coin(F, G, R" x 
[0,1]) = {0} X /. This coincidence set is compact, and thus the homotopy is 
admissable. 

The homotopies h~^{F{j{z),t)) and h~^{G{j{z),t)) give an admissible ho- 
motopy of {f,g,U,V,0) to the tuple (f , g' ,U,V,0'), where f'\u^ is the con- 
stant map with constant value y and g'\u^ is the homeomorphism g'\u^ '-Ux ^ 
j"i(R") given by 

g'\u.=h-^o[g' -f')oj, 

and O' is an orientation of C{f',g') which is related by the homotopies to O. 
By perhaps composing with an orientation reversing automorphism of R", we 
can make our initial choices of j and h so that sign(g', 0(x, y)) = 1. 
By the Homotopy Axiom we have 

iif,g,U,V,0)^L{f',g',U,V,0'), 

and by the Normalization Axiom this value is 1 £ Z2, and thus is unique. □ 

As in Corollarv \20\ we obtain: 

Corollary 38. // t : 2? — s> R © Z2 satisfies the axioms, it has values m Z Z2. 

5 The values of the index 

Sections [3] and m discuss coincidence indices with values in Z and Z©Z2, respec- 
tively. It is natural, especially in the second case, to wonder why these groups 
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in particular are chosen for the values of the index. Local indices with values in 
other abelian groups arise in the setting of coincidences of maps from a complex 
into a manifold of the same dimension in [5], fixed points of fiber preserving 
maps in [3], and coincidences in positive codimension in [T^], |13) . 

In this section we show that for maps on manifolds, any index-like functions 
having values in an abelian group must essentially be the same as our index 
functions above with values in Z or Z © Z2 . 

First we consider a setting analogous to Section [3] Then our uniqueness 
result is as follows: 

Theorem 39. Let G be an abelian group, and let a ^ G. Then there is at most 
one function La '■ C ^ G satisfying the following axioms: 

• (Additivity) Given (/,<;,[/, O) G C, if Ui and U2 are disjoint open subsets 
of U with Coin(/,5, U) dUiD U2, then 

Laif,g,U,0)^iaif,g,U,,0) + iaif,g,U2,0). 

• (Homotopy) If (/, g, [/, O) G C and (/', g' , U, O') G C are admissibly homo- 
topic, then 

ia{f,g,U,0)^Laif',g\U,0'). 

• (Normalization) Let (c, g, U,0) C with c\ij a constant map with constant 
value c and g\u an embedding with g{x) — c. If sig'n{g,0{x, c)) — 1, then 

La{c,g,U,'Q) = a. 

The proof of the above cannot follow exactly the proof of TheoremlTQlwithout 
a G- valued analogue of Lemma [171 But the ideas from the proof of Theorem 
[371 can apply to change any pair of maps (/, g) by homotopy so that, near 
each isolated coincidence point, the pair consists locally of a constant and an 
embedding. In this case the normalization axiom will determine uniquely the 
values of La- Since the value of can always be computed using the additivity 
and normalization axioms, we obtain 

Corollary 40. Let G be an abelian group with a G G, and let La '■ C ^ G satisfy 
the axioms of Theorem \S9[ Then the values of La are always in (a), the subgroup 
of G generated by a. 

In the case where a £ G has infinite order, the subgroup (a) is isomorphic 
to Z. This is the situation of Section [3l where G is taken to be R and a = 1. 
Typically it will be most useful in coincidence theory to choose a to have infinite 
order: if a has some finite order fc, then it will be possible to have k coincidence 
points which cannot be removed by homotopies, and yet the value of La will be 
G G. By the classical theorem of Wecken, this should not be possible when 
the dimension of the manifolds is not 2. Thus we have: 
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Theorem 41. Let G be an abelian group with a G G, and let La ■ C ^ G satisfy 
the axioms of Theorem \39[ Additionally assume that when the domains of f and 
g are not dimension 2 and Co'ui(f,g,U) cannot be made empty by homotopy, 
the index La{f, g, U, O) is nonzero. 

Then a has infinite order, and so the values of La are in (a) = Z. 

Similar arguments could be made for G-valued functions on the classes C 
and C. 

Now we turn to the class V. We obtain a uniqueness result, proved anal- 
ogously to the above, along with a weak characterization of the values of the 
index: 

Theorem 42. Let G be an abelian group, and let a,b £ G. Then there is at 
most one function i,a,b : 2? — >■ G satisfying the following axioms: 

• (Additivity) Given (/, g, [/, V, O) G T>, if Ui and U2 are disjoint open 
subsets of U with Coin(/, 5, [/) C C/i U U2, then 

LaAf. 9,U,V,0)^ ia,bif, .9, Ui, V, O) + LaAf. 9.^2, V, O). 

• (Homotopy) If {f, g,U,V,0) G V and {f',g',U,V,0') G C are admissibly 
homotopic, then 

ia.bif, 9, U, V, O) = LaAf, 9', U, V, O'). 

• (Normalization) Let (c, g,U,V,0) G V with c\ir a constant map with con- 
stant value c and g\ij an embedding with g{x) = c. If sign{g, 0{x, c)) — 1, 
then 

(a i/(x,c) GC„(/,g,M) 
\b i/(x,c) GCd(/,g,Af) 



i-a,b{c,9,U,V,- 



Furthermore, the values of such a function ia,b are always in {a,b), the subgroup 
of G generated by a and b. 

We can be more specific about the values of the index above, which must 
be in (a, &). Note that when the domains of / and g are nonorientable, it is 
possible to construct maps having two degenerate coincidence points which can 
be combined and removed by homotopy. The sum index of these coincidence 
points must be 26, but this index must also be zero since the coincidences can 
be removed by homotopy. Thus we have 2& = in G, which means that b has 
order (at most) 2. Thus similarly to the above we have 

Theorem 43. Let G be an abelian group with a,b G G, and let i,a,b : T> ^ G 
satisfy the axioms of Theorem \42\ Additionally assume that when the domains 
of f and g are not dimension 2 and Coin(/, g, t/) cannot be made empty by 
homotopy, the index La,b{f,g,U,V,0) is nonzero. 

Then a has infinite order and b has order 2, and so the values of ia,b are in 
(a,&)^Z©Z2. 
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6 The local Reidemeister trace 



Given local maps /, 5 of A/ — > with connected domain C M, we partition 
the group 7ri(A^) into Reidemeister classes as follows: two elements a, /3 G t:i{N) 
are equivalent if and only if there is some 7 g T^iiV) with 

a = 5#(7)/3/#(7)"\ 

where fjf,,g^ : TTiiV) — 7ri(iV) are the homomorphisms induced by / and g. 
Let TZ{f, g) denote the set of Reidemeister classes defined by / and g. 

If we fix lifts (local maps) f ,g oi M ^ N to the universal covering space, we 
can assign a Reidemeister class to each coincidence point. Let x G Coin(/, 5) 
with a point x G p~^{x), where p : M ^ M is the covering space projection. 
Then there will be some a G tti (N) (now viewing a as a covering transformation) 
with X G Com{af ,g). This element gives the class [a] G TZ{f,g), which we call 
the Reidemeister class of x. The correspondence of coincidence points and 
Reidemeister classes is well defined with respect to coincidence classes: two 
points in the same coincidence class will have the same Reidemeister class. 

The Reidemeister trace (sometimes called generalized Lefschetz number) is 
an invariant which captures data concerning both the coincidence index and 
the Reidemeister classes of coincidence points. In this section we show that 
the ideas from the previous sections extend to a uniqueness result for the local 
Reidemeister trace following the structure of [16j . The main result (Theorem 
3) of that paper made no explicit use of the orientability or differentiability 
hypotheses, using only the uniqueness of the coincidence index. 

6.1 The case where the second map is orientation true 

Let C be the set of aU tuples (/, /, g, g, U, V, N, O) where f,g:V C M N with 
U CV, and (/, g, [/, O) G C (so g is orientation true), the set V is the connected 
domain of / and g, and f,g (local maps) of M N are lifts of / and g to the 
universal covering spaces. We say that two such tuples {f,f,g,g,U,V,N,0) 
and {f , f , g' ,g' ,U,V, N,0') are admissably homotopic if there is an admis- 
sible (in the sense of Section pair of homotopies F,G of {f,g,U,N,0) to 
{f , g' ,U, N,0') which lifts to a pair of homotopies of / to /' and g to g' . 
The Reidemeister trace is a function RT defined on C which assigns to a tu- 
ple {f,f,g,g,U,V,N,0) an element of the abelian group UZ{f,g). We view 
this group as the set of finite formal sums of elements of TZ{f,g) with integer 
coefficients. Let e : lfR.{f, 5) -^> Z be the sum of the coefficients. 

Note that in this section we must keep track of V and N in our tuples. If we 
have f,g : M N and N is an open submanifold of some N', then it is possible 
for TTi{N) 7^ TTi{N') (and similarly for tti{V) ^ tti{V') if we change the domain 
V), and so the set TZ{f,g) will depend on the precise choice of the domain and 
codomain of /. 

Our uniqueness theorem is as follows: 
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Theorem 44. There is at most one function RT defined on C which assigns 
to a tuple (/, /, (7, 5, [/, V, A^, O) an element of the Abelian group Z7^(/, 5) and 
satisfies the following axioms: 

• (Additivity) Given {f,f,g,g,U,V,N,0) £ C, if Ui and U2 are disjoint 
open subsets of U with Coin(/, 5, [/) C t/i U U2, then 

RT(/, /, <?, g, U, V, N, O) = RT(/, /, 5, g, U^V, N, 0)+RT(/, /, g, g, U2,V, N, O). 

. (Homotopy) If {f,g,g,U,V, N,0), {f , f , g' ,g' ,U,V, N,0') G C are ad- 
missably homotopic, then 

RT(/, /, 5,5, U, V, N, O) = RT(/', 5', g\ U, V, N, O'). 

• (Normalization) Let {c,c, g,!), U, V, N,0) C with c\u a constant map and 
g\u an embedding with g{x) = c. // sign((7, 0(x, c)) ~ 1, then 

eoRT(c,?,<7,5,C/,V^,7V,0) = l. 

• (Coefficients invariance) For any {f,f,g,g,U,N,0) G C, and any a,f3 G 
7ri(iV) and any manifold N' which contains N as an open submanifold, 
we have 

e(RT(/, /, 5,5, [/, TV, O)) = e(RT(/, a/, 5, C/, V, N', O)). 

• (Coincidence of lifts) If [a] G TZ{f,g) appears with nonzero coefficient in 
KT(f, f,g,g,U,V,N,0), then af and g have a coincidence on p~^{U), 
where p : M ^ M is the covering space projection. 

The proof is analogous to that found in [TB] , we wih give a sketch: Letting 
RT satisfy the above axioms, the composition e o RT : C — >■ Z is independent 
of the hfts / and g and the codomain TV by the coefficients invariance axiom, 
and so we may regard e o RT as a function on C. This function satisfies the 
corresponding axioms of Section [3l and so by Theorem 1191 e o RT is uniquely 
determined. 

Now to show that RT is unique, we use the Homotopy axiom, and Addi- 
tivity and excision to form a sum over euclidean neighborhoods containing one 
coincidence point each. On some such neighborhood, say a neighborhood Ux 
of a coincidence point x, the value of RT must be some coefficient times the 
Reidemeister class associated to x (the appearance of any other Reidemeister 
class would contradict the Coincidence of lifts axiom). By the above paragraph, 
though, the coefficient must be given by the unique function t. Thus we have 

RT(/,7,g,g,[/,F,iV,0)= ^ i{f,g,Ux,0)[x], 

x£Coin{f,g,U) 
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where [x] G g) is the Reidemeister class associated to x. The above compu- 
tation of RT is derived using only the axioms, and thus establishes its unique- 
ness. 

Note that appropriate versions of Corollaries !^ and [231 will hold for this 
Reidemeister trace, by the same arguments. Also, the results of this subsection 
could be adapted as in Subsection 13.21 to give a unique Reidemeister trace for 
tuples where the first map is orientation true, or tuples where at least one map 
is orientation true. 

6.2 The general case 

Now we turn to the case where g is not assumed to be orientation true. Let D 
be the set of tuples (/, /, g, g, f/, V, O)^ where (/, g, U, V, N, O) G V, the manifold 
N is the codomain of / and g, and f,g are lifts of / and g. Define admissable 
homotopy of tuples as above. ^ 

In this general case (without any orientation-true assumptions), RT(/, /. g, g, U, V, N, 
has value in the abelian group (Z® Z2 )??.(/, g). Again, let e : (Z©Z2)7?.(/, g) — > 
Z©Z2 be the sum of the coefficients. Our uniqueness result follows from exactly 
the same arguments as in Theorem 1441 

Theorem 45. There is a unique function RT defined on V which assigns to a 
tuple (/, /, 5,5, U, V, N, O) an element of the Abelian group (Z © Z,2)TZ{f, g) and 
satisfies the following axioms: 

• (Additivity) Given {f,f,g,g,U,V,N,0) G if Ui and U2 are disjoint 
open subsets of U with Coin(/, 5, U) C Ui U U2, then 



RT(/, /, (?, 5, U, y, N, O) - RT(/, /, 5, g, C/i, iV, 0)-f RT(/, /, 5, g, U2,V, N, O). 
. (Homotopy) If {f,g,g,U,V, N,0), {f J' , g' ,g\U,V, N,0') G V are ad- 



missahly homotopic, then 



RT(/, /, g, g, U, V, N, O) = RT(/', /', 5', g', (7, V, N, O'). 



• (Normalization) Let (c, c, g, g,U,V, N,0) G T) with c\u a constant map 
and g\u an embedding with g{x) = c. If sigTi{g,0{x, c)) = 1, then 




if (x,c) G C„(c,5,F), 
if{x,c) G Cd{c,g,V). 



• ( Coefficients invariance) For any (/, /, g, g, U, V, N, O) G T>, and any a, /3 G 
7ri(A^) and any manifold N' which contains N as an open submanifold, 
we have 



e(RT(/, /, 5,5, [/, V, N, O)) = e(RT(/, af, g, /3ff, C/, V, N', O)). 
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• (Coincidence of lifts) If [a] G 7?.(/, 5) appears with nonzero coefficient in 
I{T(f, f,g,g,U,V,N,0), then af and g have a coincidence on p~^{U), 
where p : V ^ V is the covering space projection. 

We end the section with a note about the value of the Reidemeister trace. 
We can be a bit more specific about where this value lies by partitioning the 
Reidemeister classes into degenerate and nondegenerate classes following [TO] . 
Section 2, Definition 1. 

Definition 46. Let (/, g, U, V, N, O) G 2?. A Reidemeister class [a] is degenerate 
if there exists a loop 7 e t^i{V) such that a — g^{j)a{f^{-f)~^) and sign(7) ^ 
sign 5^ (7) for some a € [a]. Otherwise we say that [a] is nondegenerate. 

Denote by TZd{f,g,V) the set of degenerate Reidemeister classes and by 
T^n{f,g, V) the set of nondegenerate Reidemeister classes. 

Our final result is that, in the Reidemeister trace, the nondegenerate Rei- 
demeister classes always appear with integer coefficients, while the degenerate 
classes always appear with Z2 coefficients. Since the integer coefficients and mod 
2 coefficients appear respectively for nondegenerate and degenerate coincidence 
points, this essentially means that the degeneracy of points corresponds in the 
appropriate way with degeneracy of Reidemeister classes. 

Theorem 47. For (/, /, g, g, U, V, N, O) G V, we have 

RT(/, I g, g, U, V, N, O) £ ZUM, 9, V) ® Z^TZA f, g, V). 

Proof. By the Homotopy and Additivity axioms we may replace / and g by a 
pair with isolated coincidences and we have 

RT{f,lg,g,U,V,N,0)^ J2 i{f, g,U,,V, N,0)[x], 

xeCoinif, g,U) 

where Ux is a euclidean neighborhood of x containing no other coincidences, 
and [x] e TZ{f,g) is the Reidemeister class associated to x. 

By the proof of our uniqueness for RT, the coefficient on [x] must be the 
coincidence index t on Ux. By the proof of Theorem [371 this coefficient is 
in Z when x G Cn{f,g,V), and is in Z2 when x G Cd{f,g,V). (The maps 
can be changed by admissable homotopy so that each coincidence point has a 
neighborhood on which the Normalization Axiom applies.) 

Thus it suffices to show that x G C„(/, g, V) if and only if [x] G 7?,„(/, g, V), 
which will imply that x G Cd{f, g, V) if and only if [x] G TZd{f, 5, V). 

The class [x] is the Riedemeister class of the covering transformation a such 
that X G pCoin{af ,g). We begin by showing that if a; G C„(/, g, V^), then 
[x]enM,g,V). 

Let [a] = [x] be the Reidemeister class of x. This means that there is a 
point X with p(x) — x and af{x) — g{x). To show that [a] G ??.„(/, g,M), we 
assume that a — .9^(7)0/^(7^"'^) for some 7 G 7ri(y,a;o), and we will show that 
sign 7 = sign 5^(7). 
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Let A : [0, 1] ^> be a path from xa to x. Let 6 be the loop at x given by 
9 =^A*7*A~^, and let 9 be the lift oi6 with initial point x. The terminal point 
of 9 will be jx, viewing 7 as a covering transformation. 

Then the terminal point of af{6) will be 

afiix) = af^{-i)f{x) = g#{j)af{x) = g#{'y)g{x) = 5(7^), 

which is the terminal point of g{9). These paths af{9) and g{9), being two 
paths in the universal cover with the same endpoints, are homotopic. Thus 
their projections are homotopic, and so f{9) ~ g{9). 

Since x G Cn{f,g,V) and is a path at x with f{9) ~ g{9), we have 
sign0 = signg{9). Since 6* = A * 7 * A~^, this means that sign7 = sign (7^(7) as 
desired. 

Now we assume that [a] — [x] G TZn{f,g,V), and we will show that x g 
^n{f,g,V). Let be a loop at x with f{9) ~ g{9), and we will show that 
sign0 = sign g (9). 

As above, choose x with p{x) — x and af{x) = g(x), and let A be a path 
from xo to x. Let 7 = A~^ * * A. Let 9 be the lift of 9 with initial point a;. 
Then the terminal point of 9 will be^7Jc. ^ 

Since f{9) ~ g{9), the paths af{9) and 3(6*) will be homotopic, and in partic- 
ular have the same endpoints. The terminal point of the former is af{^x), while 
the terminal point of the latter is g{jx). Equating these gives aj^{'^)f{x) = 
g^{-f)g{x), and since g{x) = af{x) we have af#{j)f{x) = g#{j)af{x), which 
means af#{j) = g#{'y)a, and thus a = g#{'y)af#{'-f~^). 

Since [a] G TZn{f,g, V) we have sign7 = sign 5^(7). Since 7 = A^^ * 9 * X, 
this means that sign 6* — sign g{9) as desired. □ 

As a final note, we point out that the ideas of Section [5] could be extended 
using the same arguments to specify the values of the Reidemeister trace. Specif- 
ically we can show that any appropriate function on C with values in GTZ{f, g) 
for some abelian group G must always have values in {a)TZ{f,g) = ZTZ(f,g) for 
some infinite order element a € G. Similarly, any appropriate function on 2? with 
values in GTZ{f,g) must always have values in {a)TZn{f,g,V) {b)TZd{f,g,V) 
where a G G has infinite order and h E G has order 2. 

Appendix- Existence 

Here we briefiy discuss the existence of the various indices and Reidemeister 
traces above. 

For the coincidence index i : C -t- Z of Subsection [3l the proof of Theorem 
[TOl gives a construction: choose small Euclidean neighborhoods around each 
coincidence point (assuming there are finitely many), and use the classical local 
coincidence index on R" after composing through charts. It could be checked 
that L defined in such a way does not depend on the choices of charts, and 
that it does indeed satisfy the three axioms of Subsection [3l (These checks, as 
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well as the assumption that the coincidence set be finite, are avoided using a 
homological construction outlined below.) 

A similar strategy sufBces to construct the unique function t : 2? — > Z Z2 . 
Let /, g be local maps of M N, and as before assume that the coincidence set 
is finite. For each x e Coin(/, U), we can compute the above classical local 
index on a euclidean neighborhood of x. This computation yields an integer 
whose sign depends on choices of orientations made at the point x and the 
point f{x). If J7r C [/ is a Euclidean neighborhood of x which contains only 
X as a coincidence point, this classical index will coincide with what is denoted 
in our notation by L{f,g,Ux,Ux,N,0), where O agrees with the orientations 
chosen above. Note that 5, Ux, Ux, N, O) is an integer (not in Z2), since Ux 
is orientable. 

The unique function /, : 2? — > Z © Z2 discussed in this paper can be con- 
structed in terms of the classical indices by the formula 

iif,g,U,V,N,0)^ I J2 iif,g,Ux,Ux,N,0)\®ql iif, g,Ux,Ux, N,0) 

\(an,y)GC„(/,s,C/) / \(x,y)eCM,9,U) 

(3) 

where g : Z — >■ Z2 is reduction mod 2. The procedure above is perhaps the 
most naive way to define the local concepts in question, at least if the number 
of coincidence points is finite. 

With this approach, it is also straightforward to define a local Reidemeister 
trace in ZTZn{f,g,M) © Z2Tld{f, g, M) whose image under e (the sum of the 
coefficients) is the local coincidence index t: if the Reidmeister class of some 
coincidence point x is nondegenerate, then the local Reidemeister trace is the 
element of Z7?.„(/, g, M) given by the classical index of x times the Reidmeister 
class of X. If this class is degenerate, then the local Reidemeister trace is the 
element of Z27^d(/, g, M) given by the mod 2 reduction of the classical index of 
X times the Reidmeister class of x. 

An alternative approach for these constructions, which will apply in the gen- 
eral case where the set of coincidence points is not finite, is via the homological 
machinery of |6j. Certainly one could deform the maps to make the number 
of coincidence points finite and then define the index in terms of the deformed 
maps. But one would need to show that the final result is independent of the 
deformation. This is avoided in the homological approach. 

Given a tuple (/, f,g,g, U, V, N, O) e V, the obstruction to deform the pair 
to be coincidence free lies (see Theorem 2.9 in [6 ) in the group _ff"(V,Z[7r]) 
(cohomology with compact support), with tt — 7ri(iV). By Poincare duality this 
group is isomorphic to the quotient of Z[7r] by the action of tti{V) on Aut(Z[7r]). 
Using this action, which is given in [6 , it is not difficult to show that this 
quotient is isomorphic to ZTZn{f,g,V) (B 'Z2TZd{f, g,V). 

Now given C C J7 an isolated set of coincidence points, we consider the 
obstruction to deform f,g:U—)-Ntohe coincidence free. This is an element 
7(/, g) of the cohomology H"{U, U — C; Z[7r]), which by excision is isomorphic 
to H'^{M,M - C;Z[7r]). Define the class j{f,g;U) e H^{M, Z[Tr]) using this 
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isomorphism and the induced map by the inclusion i* : H"{M, M — C; Z[7r]) — >■ 
H"{M; Z[7r]), which is the local Reidemeister trace. Then the local index is the 
image of 7(/, g; U) in Z © Z2 by e. 

The unique local index t : 2? Z © Z2 discussed in this paper is also closely 
related to the "semi-index" of Dobrenko and Jezierski described in [3]. We 
conclude by showing how formula ([3]) for l relates to the semi-index. 

Recall that when g is orientation true, as we saw in Proposition|6l a choice of 
orientation at a single coincidence point uniquely determines a ^-coherent ori- 
entation of C(/, g). Thus there are exactly two possible 5-coherent orientations: 
call them O and — O. From Corollary E51 we have 

i(/,g,C/,7V,-0) - -/,(/, TV, O). 

Thus the index in the orientation true case is, up to sign, independent of the 
orientation chosen. Equivalently, we could say that the absolute value of the 
index is independent of the orientation chosen. 

In the case where g is not orientation true the situation is more complicated. 
We have defined the index in terms of a Nielsen coherent orientation, which 
is uniquely determined when we choose an orientation at one point in each 
coincidence class. 

Thus there are perhaps many possible Nielsen coherent orientations, and 
we only expect the index to be independent of orientation (up to sign) within 
Nielsen classes. More precisely, if Coin(/, U) is a coincidence class, then there 
are only two Nielsen coherent orientations for C(/, g) n ?7 x TV, and they will give 
opposite values for the index. Thus when Coin(/, g, U) is a coincidence class, 
the quantity |;,(/, 5, C7, V, 0)| G Z will be independent of O. Here, the "absolute 
value" used is | • | : Z © Z2 — !> Z, computed as the usual absolute value of the Z 
part, plus 1 if the Z2 part is nontrivial. 

This quantity g, U, V, N, 0)| (using the above absolute value) coincides 
with the semi-index of [3] for the coincidence class Com{f,g,U). Dobrenko 
and Jezierski begin by dividing the coincidence set (of a regular pair) into "free 
elements" and pairs of "reducing elements" , and define the semi-index as the 
number of coincidence points remaining after deleting a maximal set of reducing 
pairs. 

Those coincidence points which appear in reducing pairs are precisely the 
points of Cd{f,g,V) together with pairs of points of Cn{f,g,V) having oppo- 
site indices (see Theorem 5.3 of [9]). Thus the reducing pairs consist of pairs of 
nondegenerate points whose index sum is zero, plus some even number of de- 
generate coincidence points. The value of the semi-index, then, is the (absolute 
value of the) index sum of the nondegenerate points, plus one if the number 
of degenerate points is odd. This (in absolute value) gives precisely dSj) when 
Coin(/, g, U) is a coincidence class. 
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